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Abstract 

In this paper, we study the problem of formation keeping of a network of strictly passive systems when very 
coarse information is exchanged. We assume that neighboring agents only know whether their relative position 
is larger or smaller than the prescribed one. This assumption results in very simple control laws that direct the 
agents closer or away from each other and take values in finite sets. We show that the task of formation keeping 
while tracking a desired trajectory and rejecting matched disturbances is still achievable under the very coarse 
information scenario. In contrast with other results of practical convergence with coarse or quantized information, 
C^ here the control task is achieved exactly. 
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Distributed motion coordination of mobile agents has attracted increasing attention in recent years owing to its 
wide range of applications from biology and social networks to sensor/robotic networks. Distributed formation 
f — keeping control is a specific case of motion coordination which aims at reaching a desired geometrical shape for 

^-H the position of agents while tracking a desired velocity. This problem has been addressed with different approaches 

^^ ll32]| . |J2J, 1.29 J . LZl, ll24l . Bl . BOJ . In problems of formation control, an important component, besides the dynamics 

of the agents and the graph topology, is the flow of information among the agents. In fact, the usual assumption in 
the literature on cooperative control is that a continuous flow of perfect information is exchanged among the agents. 
However, due to the coarseness of sensors and/or to communication constraints, the latter might be a restrictive 
requirement. To cope with the problem in the case of continuous-time agents' dynamics, the use of distributed 
quantized feedback control has been proposed in the literature fTTl, |T8|, ||9l, ifTOl . In fact, in formation control by 
quantized feedback control, information is transmitted among the agents whenever measurements cross the thresh- 
olds of the quantizer At these times, the corresponding quantized value taken from a discrete set is transmitted. 
^f^ This allows to deal naturally both with the continuous-time nature of the agents' dynamics and with the discrete 

i^\ nature of the transmission information process without the need to rely on sampled-data models [9j, lfT2l . fTTl. 

OO Literature review. The research on coordination in the presence of quantized or coarse information has mainly 

^. focused on discrete-time systems (['231, fT9l. f8l> f^^l to name a few). Motivated by the problem of reaching 

■^ consensus in finite-time, I llJ adopted binary control laws and cast the problem in the context of discontinuous 

^^ control systems. The paper ifTOl proposed a consensus control algorithm in which the information collected from 

^_J the neighbors is in binary form. The paper fTSl has investigated a similar problem but in the presence of quantized 

. . measurements, while [9J has rigorously cast the problem in the framework of non-smooth control systems. The 

. ^ latter has also introduced a new class of hybrid quantizers to deal with possible chattering phenomena. Results on 

k^ the formation control problem for continuous -time models of the agents in the presence of coarse information have 

^ also appeared. The authors of 1341 study a rendezvous problem for Dubins cars based on a ternary feedback which 

^ depends on whether or not the neighbor's position is within the range of observation of the agent's sensor. Deploy- 

ment on the line of a group of kinematic agents was shown to be achievable by distributed feedback which uses 
binary information control 1141 . In 1121 . H7I formation control problems for groups of agents with second-order 
non-linear dynamics have been studied in the presence of quantized measurements. Leader-follower coordination 
for single-integrator agents and constant disturbance rejection by proportional-integral controllers with quantized 
information and time-varying topology has been studied in [33 1. In this paper, we consider nonlinear agents and we 
adopt internal model based controllers to track reference velocities and reject constant and harmonic disturbances. 
On the other hand, we restrict ourselves to static graph topologies. 

Main contribution. In this paper, we study the problem of distributed position-based formation keeping of a group 
of agents with strictly-passive dynamics which exchange binary information. The binary information models a 
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sensing scenario in which each agent detects whether or not the components of its current distance vector from a 
neighbor are above or below the prescribed distance and apply a force (in which each component takes a binary 
value) to reduce or respectively increase the actual distance. A similar coarse sensing scenario was considered in 
||34ll in the context of the so-called "minimalist" robotics. 

Remarkably, despite such a coarse information and control action, we show that the control law guarantees exact 
achievement of the desired formation. This is an interesting result, since statically quantized control inputs typi- 
cally generates practical convergence, namely the achievement of an approximate formation in which the distance 
from the actual desired formation depends on the quantizer resolution |12|. Here the use of binary information al- 
lows us to conclude asymptotic convergence without the need to dynamically update the quantizer resolution. The 
use of binary information in coordination problems (| iT, TOl) has been proven useful to the design and real-time 
implementation of distributed controls for systems of first- or second-order agents in a cyber-physical environment 
(see e.g. lISTllZTlfTSl ). We envision that a similar role will be played by the results in this paper for a larger class 
of coordination problems (see fTSl for an early result in this respect). 

Another advantage of our approach is that the resulting control laws are implemented by very simple directional 
commands (such as "move north", "move north-east", etc. or "stay still"). We also show that the presence of coarse 
information does not affect the ability of the proposed controllers to achieve the formation in a leader-follower set- 
ting in which the prescribed reference velocity is only known to the leader. This paper adopts a similar setting as in 
ifTSlfTTl but controllers and analysis are different. Moreover, the paper investigates the formation control problem 
with unknown reference velocity tracking and matched disturbance rejection that was not considered in ifTSlfTTl . 
Compared with [34] , where also coarse information was used for rendezvous, the results in our contribution apply 
to a different class of systems and to a different cooperative control problem. Early results with the same sensing 
scenario but for a formation of agents modeled as double integrators have been presented in fZT]. 

The paper is organized as follows: Section [2] introduces the problem statement along with some motivations 
and notation. Analysis of the formation keeping problem with coarse data in the case of known/unknown reference 
velocity is studied in Section [3] Section |4] investigates the problem of formation keeping with coarse data in the 
presence of matched disturbances. Related simulations are presented in Section l5] The paper is summarized in 
Section |6] 

Notation. Given two sets 5*1, 52, the symbol Si x 52 denotes the Cartesian product of two sets. This can be 
iterated. The symbol X )!Li ^k denotes 5i x 52 x . . . x Sm- For a set 5, card(5) denotes the cardinality of the set 
5. Given a matrix M of real numbers, we denote by TZ{M) and M{M) the range and the null space, respectively. 
The symbols 1, denotes vectors or matrices of all 1 and respectively. Ip is the py.p identity matrix. Sometimes 
the size of the matrix is explicitly given. Thus, 1„ is the n-dimensional vector of all 1. Given two matrices A, B, 
the symbol A^ B denotes the Kronecker product. 

2 Preliminaries 

2.1 The multi-agent system 

In this subsection we review the passivity-based approach to multi-agent system control (|2|, see also ll5l l25l[T7l ). 
A network of N agents in MP are considered. For each agent i, xi e W represents its position. The communication 
topology of the network is assumed to be modeled by a connected and undirected graph G — (V, E), where V is 
a set of N nodes and i? C V^ x y is a set of 7\f edges connecting the nodes. Label one end of each edge in E with 
a positive sign and the other end with a negative sign. We define the relative position Zk as following 

_ { Xi — Xj if node i is the positive end of the edge k 
[ Xj — Xi if node j is the positive end of the edge k 

where Xi £ MP is the position of the agent i expressed in an inertial frame. We define the N x AI incidence matrix 
B associated with the graph G as follows 

^-l If node i is the positive end of the edge k 
bik = •^ —1 If node j is the positive end of the edge k 
otherwise. 

By definition of B, we can represent the relative position variable z, with z = [zf . . . zj_f]'^, z £ M^*^, as a 
function of the position variable x, namely 

z = {B^ (g) Ip)x. (1) 



Equation (mi, implies that z belongs to the range space TZ{B^ (g) Ip). 

Each agent is expected to track its desired (time-varying) reference velocity denoted by w[. Define the velocity 

error 

yi^Xi- w[. (2) 

The dynamics of each agent is given by 

^^ . J ii^ Mil) +9i[ii)ui ^3^ 



Vi = ^j(6) 

where ^i € K"' is the state variable, Ui G W is the control input, yi E M.^ is the velocity error, and the exogenous 
signal w[ e MP is the reference velocity for the agent i. The maps /,, g, and hi are assumed to be locally Lipschitz 
such that /i(0) = 0, (?i(0) is full column-rank, and hi{0) = 0. 

The system Hi is assumed to be strictly passive from the input Ui to the velocity error yi. Since the system Hi is 
strictly passive, there is a continuously differentiable storage function Si : M"' -^ M+ which is positive definite 
and radially unbounded and satisfies 

-^mii) + ftte)".] < -W^,:te) + Vr^Ui (4) 

oii 

where Wi is a continuous positive function and VFi(O) ~ 0. 

For the sake of conciseness, the equations (J2]i and ([3]l are written in the compact form 

/ /ii(6) 
X — '■ 

V hN{£,N) ) \v'^ 

"^ ^— 

K(.) 
( /i(6) \ / .91 (a) ... \ (5) 

i^ ; 




We define the concatenated vectors x ^ \x\ . . . x^]'^, x € M^^, x, G W, and ^ ^ [^f . . . ^^]^, ^ e M^^, 
^, € W. The desired position x*, with x* = [xl'^ . . . x^"^]^, x* € M^^, x* e M^ is given by x* ^ x^ + In (E> 
Jp w*(s)(is, with Xq a constant vector Analogously, z* = [zj'^ . . . zj/^]^' -2* ^ IRp*^, z* S R^, is the desired 
relative position vector. The two vectors are related by the identity z* = {B^ Ip)x*. 

2.2 Problem Statement 

Our goal is to design coordination control laws to attain the following collective behaviors for the formation of 
agents (|2]i, Q: 

(i) The velocity of each agent of the network asymptotically converges to the desired reference velocity v* (t) e 

W 

lim p,(t)-t)*(t)|| =0, i^l,...,N. (6) 

(ii) Each relative position vector Zk converges to the desired relative position vector z^ 

lim ||zfc-z^||=0, zleKP, k^l,...,M. (7) 

t— foo 

(iii) In the presence of matched input disturbances, i.e. in the case in which the equation ^ is replaced by 

it = fi{£,i) + gt{^t){ut + d,) 

where di is a disturbance signal generated by a suitable exosystem (see Section HI), the collective behaviors 
in (i) and (ii) are still guaranteed. 



Differently from other work in formation control, we are interested in control laws that achieve complex coordi- 
nation tasks using very coarse information about the relative positions of the agents. We assume that the agents 
of the network are equipped with sensors that are capable to detect whether the relative position of two agents is 
above or below a prescribed one. 

In line with our goals, for each agent i, the control law is designed as 

M 

u,j = - ^ bik sign(zfc - 2fc), i = 1 ... iV, (8) 

fc=i 

where sign() is the sign function and operates on each element of the p-dimensional vector Zk — z'^. The sign 
function sign(-) : M — > {—1, +1} is defined as follows: 

. ,.. f +1 if C>0 
sign(C)-| -1 if C<0. 

Observe that, bik 7^ if and only if edge k connects agent i to one of its neighbors. This implies the control law 
Ui uses only the information available to agent i. The above control law is inspired by the passivity-based control 
design proposed in |,2J. 

Discussion about the control ([S|. The proposed control (J8]l has the following interpretation. Let the position of the 
agents be given with respect to an inertial frame in MP . Assign to each agent a local Cartesian coordinate system 
with an orientation identical to the inertial frame such that the current position of the agent is the origin of its 
local coordinate system. Therefore, there are p mutually perpendicular hyperplanes intersecting at the origin of the 
agent's local coordinate system and partitioning the state space into 2^ hyperoctants. For each neighbor of agent 
i, the corresponding p-dimensional vector Zk — z^. lies in one of these hyperoctants (possibly at the boundary) and 
contributes the term — 5,;fcsign(zife — z*^,) to the control Ui. 

The implementation of dSll only requires the agent to detect when Zk — zl is crossing the boundary between 
hyperoctants Q A few other advantages of this sensing scenario are discussed below: 

(i) The formation is achieved with large inaccuracies in the measurements of Zk — z^. As a matter of fact, the 
calculated control vector corresponding to a given vector -~bik{zk — z^) is the same no matter where {zk — z^,) 
precisely lies in the hyperoctant. 

(ii) If agent i detects that the vector Zk — z^. is crossing the boundary of any two hyperoctants, then a new control 
vector is applied due to the term —biksign{zk — z^) in (Isl. In our analysis below, however, we show that the exact 
formation is still achieved if this control vector at the boundary takes any value in the convex hull of the two control 
vectors associated with the two hyperoctants. In this respect the control dSll is robust to possible uncertainties in 
the precise detection of the boundary crossing. 

(iii) The proposed control law guarantees the achievement of a desired formation by very simple directional com- 
mands, namely move closer if the actual position is larger than the desired one, move away if smaller. 
(iv) The input ^ provides a finite-valued control that uses binary measurements. In the case of networks of 
kinematic agents, the finite-valued control law of [ 1 1 1 inspired the design of self-triggered control algorithms (see 
ifTSJI ). These algorithms are shown to reduce the amount of time during which sensors are active and to reduce 
the amount of information exchanged among the agents. Moreover, they can be used to overcome possible fast 
switching of the controllers (see discussion in SectionlSll. The control investigated in this paper can pave the way 
towards the design of self-triggered cooperative control of nonlinear systems. A first step in this regard has been 
taken in |16|. 

3 Analysis 

In this section we investigate the stability properties of the closed-loop system. We define the variable z ~ z — z* 
and write the control laws Ui, i = 1,2, ... ,N,m the following compact form 

u = -(S(g)/p)signz. (9) 

From equation (m), we can write z = {B^ (g) Jp ) (x — x* ) . We consider the stability of the origin of the error system, 
with state variables [£/^ z^Y . To derive the error system equations, we take the derivative of z, thus obtaining 

i^{B'^ ®Ip){x~x*). (10) 



'in that regard, the control law is reminiscent of the controllers of (|34|) that changes when a neighbor enters or leaves the field-of-view 
sector of the agent. 



From equation (J5]l, we further have 

X - i* ^ h{£_) + v"^ - In <» V* (11) 

where v* is the desired reference velocity for the formation. By a property of the incidence matrix of a connected 
graph, {B^ (g) Ip){lN (E) v*) = 0. Thus, we represent the dynamics of the error system in the following general 
form 

i = (s^ ® ip)x = {b'^ ® ip){h{0 + «'■) 

(12) 



The system ( 12 1 has a discontinuous right-hand side due to the discontinuity of the sign function at zero. Before 
analyzing the system, we first define an appropriate notion of the solution. In this paper, the solutions to the system 
above are intended in the Krasowskii sense. 

As in f9"T7l, the motivation to consider these solutions lies in the fact that there exists convenient Lyapunov 
methods to analyze their asymptotic behavior and that they include other notions of solutions such as Caratheodory 
solutions if the latter exist. Let X = (z, ^) and let F{X) be the set-valued map 

where /C sign z = X ^.^^ X f^i K, sign Zki and 

v ■ ~ / {signzfcj if Zkt^O ,,.. 

^'^^""'=^=1 hl,l] ^f 5.. = 0. ^^4^ 



We define X{t) = (z(i),^(i)) a Krasowskii solution to ( 12 1 on the interval [0, ti] if it is an absolutely continuous 
function which satisfies the differential inclusion 

Xit) e F{X{t)) (15) 

for almost every t e [0, ti], with F defined as in ( pj) , and 

JC{F{X))^f]co{F{B{x,6j)), (16) 

<5>0 

with CO the closed convex hull of a set and B{x, S) the ball centered at x and of radius 6. Local existence of 
Krasowskii solutions to the differential inclusion above is always guaranteed (see e.g. EOl and 121, Lemma 3). 
For the convenience of the reader, a brief reminder about non-smooth control theory tools adopted in this paper is 
given in Appendix A. 

3.1 Known Reference Velocity 

In this section, we consider the case where the desired reference velocity, v* (t) is known to all the agents, namely 
w*" = l^v ^ V* ■ Then, the closed-loop system simplifies as 

S^{B^(g, Lp)h{0 

(17) 
^ = f{0+9iO{-B(g>Ip)sign~z. 



Proposition 1 Any Krasowskii solution to ( 17 1 exists for all t > and converges to the origin. 



Proof: The proof is based on the application of the non-smooth La Salle's invariance principle (|3 1). Consider 
the following locally Lipschitz Lyapunov function 

where ||z||i denotes the 1-norm ||z||i = ^^ \^kj\ and evaluate its set-valued derivative V{z.X) along Jl7b. We 
have 

F(i,0 = {aeM : 3u;e F(z,0 s.t. a= {w,p), for all pe dV{S,^)}. 



By the definition of F{z, ^) in ( 13 1, for any w G F{z, ^) there exists w^ E Assign z such that 



w 



_ [B' ® IpWO \ _ 



/(O J \9{0{B®Ip) 

Observe that the Clarke generalized gradient dV{z, f ) is given by 

"^^^^^^'-iP-P-yySiO ) ^"^ { [-1,+!] if h^=0 ^- 

Suppose that V{z, S,) ^ 9 and take a E V{z, ^). Then by definition there exists w £ F{z, £,) such that a — {w,p) 
for all p e dV{z, ^). Choose p £ dV{z, ^) such that p^ — w^. Thus 

[B^ ^ I,)hiO\ _ [ \ , / u,-^ V 

fiO J [giOiB^Ip))'' \^S{0J' 

= {{B^ ® lp)h{0,w') + (/(O - 9{0{B ® Ip)w^ V5(0) 

= -wiO 

Hence, for any state (z, C) such that F(z, ^) 7^ 0, F(z, ^) = {a £ R : a < -W{C)} C (-00, 0]. Therefore, the 
solutions can be extended for all i > and by La Salle's invariance principle they converge to the largest weakly 



invariant set where ^ = 0. Since v"^ = In '^ v*, from ( 13 1, any point (2, 0) on this invariant set must necessarily 
satisfy 

°=( .g(0)(i3®/p) 

for some w^ £ /Csign z. Since g{0) is full-column rank, this implies w^ £ Af{B ® Ip). Bearing in mind that 
z £ Tl{B^ (E) Ip), then {z, w^) = 0. We claim that necessarily z = 0. In fact, by contradiction, 5 7^ would 
imply the existence of at least a component Zki 7^ 0. As z^i 7^ necessarily implies w^- 7^ by definition of 
w^ £ /Csign z, then it would imply ZkiW^^ > 0, which shows the contradiction. Hence, on the invariant set, z = 
and all the system's solutions converge to the origin. D 

3.2 Unknown reference velocity 

In the previous section, we assumed that the desire reference velocity is known to all the agents. This assumption is 
very restrictive and one wonders whether it is possible to relax this assumption despite the very coarse information 
scenario we are confining ourselves. The positive answer to this question is given in the analysis below. 
The problem of the reference velocity unknown to the agents is tackled here in the scenario in which at least one 
of the agents is aware of v*. We refer to this agent as the leader ( ll29l . E4\ ). As in |l4l, we further assume that the 
class of reference velocities that the formation can achieve are those generated by an autonomous system that we 
refer to as the exosystem. Given two matrices $, F", whose properties will be made precise later on, the exosystem 
obeys the following equations 

w'' = $it;'', v*=T''w''. (18) 

Taking inspiration from the theory of output regulation (see e.g. fJT]), an internal-model-based controller can be 
adopted for each agent i = 2,3, . . . ,N, namely 

i)i = ^rji + Gui 

v\ = r"77„ i = 2,3,...,N. ^^' 

When Ui — and the system is appropriately initialized, the latter system is able to generate any w^ solution to 



( 18 1. Because v* is known to agent 1, there is no need to implement system ( 19 1 at agent 1. The input Ui, as well 



as the input matrix G are to be designed later. Define v^ — {v* V2 ■ ■ ■ Vn ) ^i^^ the new error variables 

fji ^ 7]^ ~ w" , Vi^vl-v*, i = 2,...,N, 



along with the fictitious variables 771 = 0, -Di = 0. We obtain 



V = 



f fii\ /o ... oN^ 

\ f)n ) \{) ... $y 



/O ... 0\/^N 

G ... i \ 



/ . 

r" . 





\ . 


. r" 1 



T" 



and in compact form 



fj = <^fi + Gu 

V = f^77, z = 1,2,3, ...,iV. 



From ([T2), the error position vector can be written as 



V ... G ) 



U2 



= {BT<E>Ip){h{0+i). 



The overall closed-loop system is 



77 = $f) + Gu. 



(20) 



(21) 



Proposition 2 Assume that $ is skew-symmetric, namely 



$-' +$ = 0, 



(r^, <1>) is an observable pair and let 



G = r 



vT 



(22) 
(23) 

(24) 



Then all the Krasowskii solutions to ( 2 1 1 in closed-loop with the control input 

u — u — ~{B (^ /p)sign z 
converge to the point z = 0, ^ = 0, 77 = 0. 

Proof: Any Krasowskii solution to pT) with the control law defined by p4| satisfies a differential inclusion 
of the form ( 13 1 where X = (2,^,77) and 



Let 



{B^(^lp){h{0 + T^fl)\ ( 

F{i,tf})=\ /(O - 9mB®Ip) I /C sign I. 

$7y / V G{B®Ip) 



V{~z,v,f}) ^ \\~z\\i + S{^) + -f f]. 



For any w e F{z, ^, ry), there exists w^' £ /Csign z such that 



w 



l>77 



9iO{B(E>Ip) ]w' 
G{B® Ip) 



Moreover for any p € dV{z, ^, ff) there exists p^ £ 9| |z| 1 1, with 

J J {sign Zki} if ht ^ 

and k = 1,2, ... ,m,i = 1,2, ... ,p, such that 



P 




For w^ £ /Csign z, let p e dV{z, ^, ?]) such that w^ — p^. Hence 

{w,p) = {{B^ ® /p)(/i(C) + f^v),w') + (/(O - giOiB ® Ip)w^VSiO) + (l-ry - G (i? ® /p)u;^ t?). 




By the conditions (22 1 and d23]), the equahty above simpUfies as 

{w,p) = {{B^ ® lp)h{0, w') + (/(C) - giOiB ^ Ip)w', V5(0). 
Since the dynamic of each agent is strictly passive, we have 

(/g) - giOiB ® Ip)w', V5(e)) < ~w{0 ~ {HO, {B ® Ip)w') 

which implies {w,p) < — W^(C)- 

Hence, similarly to the proof of Proposition 111 V{z,S,,v) ^ {a £ R : a < —W{S,)} ^ (— oo,0], provided that 

V{z, fj) 7^ 0- Because V is positive definite and proper, solutions are bounded and one can apply La Salle's 
invariance principle, which shows that every Krasowskii solution converges to the largest weakly invariant set 
where W{£,) = 0. By definition of W{£,), the latter is equivalent to have convergence to the largest weakly 
invariant set where ^ = 0. To characterize this set, we look for points [z, 0, fj) such that {z, 0, fj) E F{z, 0, fj). 
Having /(O) = /i(0) = 0, this means that we seek points {z, 0, fj) for which there exists w^ £ K, sign z such that 

g{0){B<»Ip) U;^ 
77/ V $r) / \{r''f{B<i^Ip) J 

The equality = — .g(0) {B (E) Ip)w^ , implies that necessarily z — (see the final part of the proof of Proposition 

This also implies that on the invariant set the system evolves as 

= (B^(8)/p)(f''77) 

fj = ^TJ. 

From this point on, the argument is the same as in ||4l. Indeed, as Af{B'^) — 7?.(1„), by the block diagonal structure 
of r^, we obtain that all the sub vectors of T^t] must be the same and equal to zero, since the first p component of 
r^ry are identically zero. In other words, T'"'iji = for all z = 2, 3, ... , N. Hence we conclude that on the largest 
weakly invariant set where ^ = 0, we have 

= T^v^ 
r}^ = $77,, i = 2,Z,...,N. 

By the observabihty of (F*', $), it holds that ryi = for alH = 2, 3, . . . , iV. This finally proves the claim. D 

4 Formation control with matched disturbance rejection 

In this section, we study the problem of formation keeping with very coarse exchanged information in the presence 
of matched input disturbances. 

We consider a formation of strictly passive agents, where the dynamics of each agent of the networked system 
is 

Xi = yi + <(0 



n. 



6 = /^(eO+.9^(6)("^+C^^) 
Vi = K{^i), 



(25) 



where di is a disturbance. The network should converge to the prescribed formation and evolve with the given 
desired reference velocity v* despite the action of the input disturbance d. As in the previous section, we first 
consider the case in which the reference velocity is unknown to all the agents except one. As explained in Section 
3.2 we adopt an internal-model -based controller to recover the desired reference velocity. Similarly we suppose 
that the disturbance signal di at agent i is generated by an exosystem of the form 



Wi 



<wt. 



rf^f, 



1,2, 



.N. 



To counteract the effect of the disturbance, we introduce an additional internal model controller given by 



d,. 






1,2, 



,iV, 



(26) 



(27) 



where Gf, ut will be designed later. We remark that the internal model for disturbance rejection is implemented 
also at agent 1 (the leader). 

To both compensate the input disturbance and achieve the desired formation, the proposed control law is composed 
of two parts: u guides the system to the desired formation, and d compensates the input disturbance. Therefore, 
we can write the dynamics of each agent in the following compact form 



u = ii — d 

i^IiO + giOii^-d + d). 

Define the new variable di = di — di and 9i ~ 9i — wf, then 



= ^^ 



G% 



In compact form we write 



\ en J 



/ $f 

$!^ 



\ 



Tfe.. 



\ 







/ Gi 





V 



Gi 



$d 



G'' 




Cji / 



/ rf 
r^ 



\ 



\ 





^ n / 



(28) 



(29) 



(30) 



From the equation ( [2T] i together with the equations ( [28] l, ( [30| the overall closed-loop system is 



fj = ^fj + Gu 

= ^d0^ Qd^ 



The following is proven: 

Proposition 3 Assume that $ and $f, for i — 1,2, 



G 

Gf 



,Na.m skew-symmetric matrices. If 



(31) 



(32) 



then all the Krasowskii solutions to (OTb in closed-loop with the control input 

u = u = — (_B (g) /p)signz, u — h{S,) 
are bounded and converge to the largest weakly invariant set for 



(33) 



-{B(g)Ip)IC signs -V'e 
l>fy-(f")^(B(g)/p)/Csignz 





\e J 



V 



(34) 



such that ^ = 0. 

Proof: Consider the Lyapunov function 



V{~z,d,fj,9) = Ml + SiO + lffl +^0^6 



Any Krasowskii solution to (31 1 with the control law defined by (33 i satisfies a differential inclusion of the form 
( |15| ) where X = (z, £_, i), 9) and 



J^(5,C,^,« 






V 



G{B ® Ip) 




/C sign z. 



For any w G F{z, ^, fj, 9), there exists w^ E /Csign z such that 



w 



$77 

V <^'^9 + G''h{^) J 



V 



Moreover for any p e dV{z, ^, 77, 0) there exists p^ G 3| |z| 1 1, with 



G(S ® Ip) 




w 



Pfcj e 



{sign Zki} if hi ^ 
[-1,+1] if 5fe. = 0, 



and k — 1,2, ... ,m,i = 1,2, ... ,p, such that 



/ p^ \ 



V 



/ 



For w^ G /Csign z, let p £ dV{z, ^, fj, 6) such that w^ — p'- . Hence, 

+ (/(O - 5(0((s ® ipW + T'e),vsm 

+ ($^ - G (B (8 Ip)w', 77) + (^-^^ + C^hi^), 



By the assumption ( 32 1, the above result simplifies as 

{w,p) = {{B^®Ip)h{0,w') 

+ (/(O - gims ® /p)^' + T^9),vsiO) 

+ (G'^/7(0,e). 



(35) 
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Since the dynamic of each agent is strictly passive, we have 



When it is replaced in (35 1, it gives {w,p) < —W{S,), in view of V^ = (G"*)"^. As in the previous proofs, this 

shows V{z, 0^1,0) — {a £ M. : a < ~W{£,)} and hence boundedness of the solutions and their convergence to 
the largest weakly invariant set for the closed-loop system such that ^ = 0. This proves the thesis. D 

PropositionlSlonly proves boundedness of the solution and convergence of the velocity of each agent to its own 
reference velocity (^ = 0). To prove the convergence of the network to the desired formation and evolution of the 
network with the desired velocity, one should additionally prove that z converges to the origin. This result does 
not hold in general but there are a few cases of interest where this is true. In what follows we study two of these 
cases. 

Case I: $ = 0, <l>f = Opxp, « = 1, 2, . . . , A^, the graph Q has no loops and f ", ff, i ^ l,2,...,N, are 
nonsingular. 

This case correspond to the scenario in which the unknown reference velocity and the disturbances are constant 
signals. The arguments below show that the distributed control laws characterized in Proposition [3] guarantee the 
achievement of the desired formation and the prescribed velocity while rejecting the disturbances in the special 
case in which the edge Laplacian B^B of the graph is non-singular. The latter is true if the graph has no loops 
(||24l). From Proposition [3] it is known that the system converges to the largest weakly invariant set for (34i such 
that ^ = 0. In the case $ = 0, ^f — Opxp, this implies that for any state {z, ^, fj, 6) — (z, 0, ry, 6) on this set, and 
for any w G F{z, ^, 77, 0), there exists w^ e /C sign z, such that 

= -{B®ip)w~^ -v^e 
^ = 0. 



From = 0, we conclude that 6* is a constant vector. Hence, considering the second equality in ( 36 1, we conclude 
that {B (E) Ip)w'^ is a constant vector Bearing in mind that the graph is a tree, then the edge Laplacian B^B is 
invertible, and we infer that w^ is also constant. From the third equation we deduce that each component of fi{t) 
evolves with law at + /3. However, this would contradict the boundedness of the solutions. Hence, fi{t) must be 
constant. Hence, necessarily {B (g) Ip)w^ = 0. Recalling the proof of the Proposition 1, the latter implies z = 0, 



and in particular z — 0. Now, consider the first equality in ( 36 1 and multiply both sides hy B^Ip. Since z = 0, we 
obtain = {BB^ (g) /p)(r"77). From the property of the Laplacian of a connected undirected graph, we conclude 
r^fj = TI{1n ® Ip)- From the definition of F^ry, we have V"-!] — and hence 77 = 0. Moreover, V^O — shows 
that 9^0. 

The arguments above allow us to infer the following: 

Corollary 1 Assume that $ = and <f>f = 0, for i = 1, 2, . . . , A^. Also assume that F", ff , i = 2, 3, . . . , A^, are 
non-singular and the graph G has no loops. If 



G^ = {FY, 



(37) 



then all the Krasowskii solutions to the system pTh in closed-loop with the control input 

w = w = — (i? (8) /p)signz, u = h{0 (38) 

are bounded and converge to the origin. 

Remark 1 (Limitations due to coarse information) The assumption on the invertibility of F", Tf is a mild one. 
In fact it is tantamount to assume that each velocity component must track a constant reference velocity and each 
input channel is affected by the disturbance. 

The assumption on the absence of loops in the graph is a technical assumption needed to overcome the limitations 
due to the use of coarse measurements in the proof. In fact if sign z is replaced by z, then in the proof one can use 
a different argument that does not require the invertibility of the edge Laplacian. 



As a matter of fact, the second identity in (36i becomes = —{B®Ip)z — V^O, from which it follows that 
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= -(B (g) Ip)z. The latter and the identity z = {B'^ ® Ip)^''v yield that = {BB'^ (g) Ip)^?! and therefore 
~ T'^f]. From here the proof is similar to the previous one. In other words, the use of z allows immediately to 
infer that — T^fj from which the proof can be continued without any further obstruction. 

Case II: Harmonic disturbance rejection with known reference velocity. 
We consider now the case in which the reference velocity is known and the controller only adopts an internal model 
to reject the disturbances. In this case, the system ( [3T| becomes 

I = (B^ (g) jp)/^(0 

i = fiO + gmu-T'^e) (39) 

e = ^'^e + G'^u. 

The choice C^ — (F'')-^, u = —{Bi^Ip)signz, u — h{^) as designed in PropositionBlyields that all the Krasowskii 
solutions to the closed-loop system 

S = {B^<E>Ip)h{0 

i = /(O+.9(e)(-(S®/p)signz-F'i0~) (40) 

= ^d0 + {T'^)Th{^) 



are bounded and converge to the largest weakly invariant set for (BOjl such that ^ = 0. In the case of harmonic 
disturbances, disturbance rejection can be proven. 

Corollary 2 If for i = 1,2 . . . ,N the exosystems have matrices (Tf, $f ) of the form 

ujii \ f ^ip 



$, =block.diag^^_^^^ ;'•••' V -u^r, 
with Wy ^ for all j = 1, . . . , p, and 

F,f = block.diag{F^i,...,F,^} 



with F^ 7^ 0, for all j = 1, . . . ,p, then all the Rrasowkii solutions to (40i converge to the set of points where 
^ = and z = 0. 

Proof: For the sake of notational simplicity, we present the proof in the case p =1, but this assumption does 
not change the result for the general case p > 1. 



A solution on the weakly invariant set for (40 1 is such that (z, 9) satisfies 

1 = 

9 = <^'^9 



(41) 



and there exists w^' £ JC signz such that = g{Q){—{B®Ip)w^- — V'-ff). Since by assumption 5(0) is full-column 
rank, the latter is equivalent to 

= -{B®Ip)w~^ -V^f). (42) 



From ( |42] i, 

M 



^ hkwl = -T% (43) 



fc=i 



where the term on the right-hand side is a sinusoidal function oscillating around zero. Considering the left-hand 

side of the equality ( [43] l, we define the following three types of links: 

(i) A-type: A link is of A-type if z^ ^ and there is one other link z^i ^ connected to the same node such that 

bikwl. + hik'W^, — 0. Note that the number of A-type links of each of the nodes of the graph is even. 

(ii) B-type: A link is of B-type if z^ 7^ and there is no other link connected to the same node that cancels the 

term -bikW^. 

(iii) C-type: A link is of C-type if Zk = 0. Therefore, according to the Krasowski notion of solution, the term 

bikW^ can take any value in the interval [—1,1]. 



Since z = 0, z is a constant vector. We claim that the constraint (43 1 implies that the links of each node can be 



of C-type only. As a first step, we argue that a B-type link cannot exist. Assume, there are B-type links connected 
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to the node i. This would imply a constant term in the left-hand side of (43 i that would contradict the equality (43 i 



itself, since the right-hand side of the equality is a sinusoidal function oscillating around zero. 
As a second step, we show that A-type links cannot exist. Assume by contradiction that there are A-type links 
connected to the node i. Since each link connects two nodes together, consider one of the A-type links connected 
to the node i and then consider the node at the other end of the link, that we label as i + 1. Now, consider the 
equality (43 1 for the node i + 1 and follow the following procedure: 

1 . If the A-type link of the node i is also an A-type link for the node i + 1, then go to step 3, else go to step 2. 

2. Since a B-type link cannot exist, then the link is a C-type link and consequently Zk — 0. Go back to the node i. 
Since the link associated with zj. is a C-type link, the link associated with Zk' that satisfied bikW^ + bik'tu^, = is 
also a C-type link. Therefore, both links associated with zj., Zk' are C-type links. Now, go to step 1 and consider 
other A-type links of the node i. 

3. Continue from the node i + 1. Consider any of its A-type links, then go to step 1 and repeat the procedure from 
the node i + 1. 

At the end of this procedure, one proves that either there are no A-type links or that there is a loop C in the 
graph of A-type links. Let B be the incidence matrix associated with the loop. Then by construction 



Bw' 







where zc is the sub-vector of z associated with the loop C Since zc E TZ{B'^) and w^^ G JV{B), one can prove 
that Z£ = as in the proof of PropositionfT] This contradicts the fact that £ is a loop of A-type links. We conclude 
that type-A links cannot exist. Hence, all the links must be of C-type and therefore z = 0. The argument indicates 
that on the invariant set where ^ = 0, z must be equal to 0. D 



Remark 2 (Limitations due to coarse information (Cont'd)) If we remove the limitation on the available mea- 
surements, i.e. if we replace signz with z, then the result above can be extended to exosystems having also eigen- 
values at zero, thus allowing for disturbances that are a linear combination of constants and sinusoidal signals. In 
fact, if this is the case, the largest invariant set for ([39| such that ^ = 0, includes the set of points for which the 



solution to (41 1 issuing from these points satisfies (cf. (|42|) 



= -{Bi 



ipYz - r-^ 



(44) 



Moreover, z is a constant. Repeated differentiation of = —{B®Ip)z — T'^6 implies 






6 = Q. 



(45) 



In view of the diagonal structure of (F"^, $'^) (see ( 30 1), it holds true tharl 






V -Tii^ir J 



e, = 0. 



Assuming observability of the pairs (r^,$^), and that $^ ^ 0, the matrix is full-column rank and Oi = 0. 
Since this is true for each i, then 9 — Q. From the identity = —{B® Ip)z — V^B, it descends that = 
— {B (g) Ip)z. Since z E TZ{B^ (g) Ip), then necessarily {z,z) = from which it follows that z = 0. This 
shows that if z is fully available, then the controls in this section guarantees that the formation is achieved along 
with disturbance rejection and without any assumption on the exosystem matrices with the exception of the skew- 
symmetry and of the observability properties. These internal-model-based controllers appear to be more general 
than others discussed in the recent literature (see e.g. |1|). Other applications of intemal-model-based controllers 
for disturbance rejection in networked systems can be found in li 131 l6l . 



^The authors would like to thank Bayu Jayawardhana for a useful suggestion on this argument. 
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■ trajectory of agent 1 
trajectory of agent 2 
trajectory of agent 3 

■ trajectory of agent 4 _ 

■ trajectory of agent 5 
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Figure 1 : The evolution of five agents in R'^ tracking a constant reference velocity only known to the leader The 
system reaches the desired formation and exhibits a translational motion with the desired constant velocity. 



5 Simulations 

In this section we present the simulation results for a group of five strictly passive systems in M^. The dynamics of 
each agent is given by 



n^ 



(46) 



where, comparing with ^, fi{^i) — —£,i, gtiCi) — I2, and /li(^i) — ^i- The agents exchange information over a 
connected graph. The associated incidence matrix is 

/ +1 \ 
-1+10 
B= 0-1+10 
0-1+1 
\ -1 / 

The desired formation has a pentagon shape with edge length equal to 2 and is defined by the following inter- 



agent distance vectors: 



[0 -2Y 



[-1 



1 



VW 



[-1 i + Vi? 



[0 2f. 

Note that the number of edges of the graph is four. The initial position of the agent is set to x{0) — [0.5 — 
0.5 0.5 1 1 0.5 0.8 1.1 0]"^. The simulation refers to the case of a formation evolving with a 
constant reference velocity known only to the formation leader (agent 1). The following are set as internal model 
pai-ameters for all agents: $ = 02x2, T" = I2, G = h, w'"{0) = [0.6 0.6]^, and r]i{0) = [0 0]^, for i = 1, . . . , 5. 
Figure ni shows the evolution of the described system with the desired constant velocity v* = [0.6 0.6]^. The 
other agents generate the reference velocity using the control laws based on the internal model principle. Figure 
[2] shows the time behavior of the horizontal component of zi, sign zi and the corresponding control ui. As time 
elapses, zi converges to the origin implying convergence to the desired relative position. While zi converges to the 
origin, sign zi and ui converge to the discontinuity surface and oscillate between +1 and —1. The state variables 
associated with the other agents exhibit a similar behavior and are not shown. Figure [3] shows the horizontal and 
vertical components of the reference velocity v* and the estimated velocities u[. The leader generates a constant 
desired velocity and the follower agents estimate the same reference velocity after some time. 

Simulation results in the presence of matched input disturbances are presented next. Figures HI and l5] show the 
state of the system with harmonic input disturbance and known reference velocity (Case II). The desired reference 
velocity is v* = [0.6 0.6]-'^ and is known to all of the agents. In this example, the following are set as the internal 
model parameters: 

1 \ a _ f 0.5 0.5 

-1 y' ^ " i^ -0.5 0.5 
^i = ^i = ^i, $4 = 0.5<I>f . Figure H shows the results when the disturbance is tackled by a controller based 
on the internal model principle. The result confirms that both the desired formation and the desired velocity are 
asymptotically achieved. Figure [5] shows the time behavior of the horizontal component of zi, signzi and the 
corresponding control ui. Similar to the case without the disturbance, while time elapses, zi converges to the 



$f 



Gf 



rf , wf{0) 



[1 1 1 1]^, $f = 2$f, 
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Figure 2: The plot of the (horizontal) x- 
component of zi, sign zi and the correspond- 
ing control ui. 



Figure 3: The horizontal and vertical compo- 
nent of the estimated reference velocity v^ for 
each agent i. The leader (agent 1) generates 
the desired velocity v* — [0.6 O.Q]^{m/s). 





Figure 4: The horizontal component of the 
disturbance estimation error 6 and the veloc- 
ity error ^ for all five agents, together with 
the horizontal component of the relative posi- 
tion vector z. Here, an internal-model-based 
controller is used to reject the harmonic dis- 
turbance. ^ and z asymptotically converge to 




Figure 5: The plot of the (horizontal) x- 
component of zi, sign zi and the correspond- 
ing control ui in the presence of harmonic in- 
put disturbance. 



origin implying convergence to the desired relative position. While zi converges to the origin, sign zi and ui 
converge to the discontinuity surface and oscillate between +1 and —1. Figures p^ and [tI show the state (z, ^, ry, ^) 
of the system with constant input disturbance and constant unknown reference velocity (Case I). The following are 
the parameters chosen for the simulation: $f = $ = 02x2, T" == Tf = /a, G == Gf = h, w'"(Q) = [0.6 0.6]'^, 
wf{Q) ~\ii + 3]"'" and ?yi(0) — [0 O]"'". The communication graph is a tree. The associated incidence matrix is 

/ -1 \ 

+1 -1 -1 -1 

Bt= 0+10 
0+10 
\ +1 / 

Figurep^shows the horizontal component of the input disturbance w"^ and the velocity ^ (for all 5 agents), together 
with the reference velocity estimation error r) (for all follower agents) and the horizontal component of the relative 
position vector z. In this simulation no internal-model-based controller is used. As shown, the desired formation 
does not track the desired reference velocity. Figure |7] shows the results after implementing the internal-model- 
based controller As predicted, the formation is achieved, the desired velocity is reached by all the agents and 
the input disturbances are rejected. Figure [8] shows the time behavior of the horizontal component of zi, signzi 
and the corresponding control ui. As time evolves, zi converges to the origin, and sign zi and ui start switching 



15 



between +1 and —1 with high frequency. This behavior may not be acceptable in practice and can be overcome 
by the hysteric quantizers studied in |9| or the self-triggered controllers of I.15J . 






f ^ ; 
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Figure 6: The horizontal component of the in- 
put disturbance w"^ and the velocity ^ (for all 
5 agents), together with the reference velocity 
estimation error fj (for follower agents) and 
the horizontal component of the relative po- 
sition vector z. In this simulation, the dis- 
turbance is constant and no internal-model- 
based controller is used. As a result, the vari- 
ables do not converge to zero. 



Figure 7: The horizontal component of the 
disturbance estimation error 6 and the veloc- 
ity ^ (for all 5 agents), together with the refer- 
ence velocity estimation error fj (for follower 
agents) and the horizontal component of the 
relative position vector z. Here, the constant 
disturbance is rejected by the internal-model- 
based controller and ^, 77, 6, z asymptotically 
converge to zero. 




Figure 8: The plot of the (horizontal) x-component of zi, sign zi and the corresponding control ui in the presence 
of constant reference velocity and constant disturbance. 
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6 Conclusion 

In this paper we considered a formation control problem with very coarse information for a network of strictly 
passive systems. We showed that despite the very coarse information, the exact formation is reached. Moreover, 
the formation tracks a desired reference velocity even in the case when the reference velocity is only available to 
one of the agents (the so-called leader). In the same coarse sensing scenario, we presented results of matched input 
disturbance rejection. We remarked that the use of coarse information poses a few limits to the formation control 
problem that can be solved. 

Possible future avenues of research include the extension of the results to deal with time-varying topologies. 
A few related results have been discussed in |12, 33| . Moreover, discontinuous control laws as those considered 
in this paper can be viewed as the outcome of a non-smooth optimization problem associated with the original 
control problem (|5|) and it would be interesting to investigate this topic more in depth. Another interesting 
topic to understand better is whether the finite-valued control laws of this paper can be used to tackle the case of 
(asymmetric) measurement noise. Finally, we observe that as the system converges to the prescribed formation, 
fast oscillations of the control inputs between +1 and —1 may occur As discussed in the simulation section, 
these oscillations could be overcome by the hysteric quantizer of |[9| or the self-triggered approach of Iil5j . A 
comprehensive treatment of this aspect is another interesting topic that deserves attention. 
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A Non Smooth Control Theory Tools 

This appendix is added for the convenience of the Reviewers only. It will be omitted from the final version of the 
manuscript. 

We recall some basic notations from the theory of nonsmooth control which will be used throughout the paper. 
Xf) G K^ is a Krasowskii equilibrium for the differential inclusion x G F{x{t)) if the function x{t) = xo is 
a Krasowskii solution to i e F{x{t)) starting from the initial condition xq, namely if G K.{F{x)). A set S 
is weakly (respectively, strongly) invariant for x G F{x{t)) if for any initial condition x £ S ai least one (all 
the) Krasowskii solution x{t) starting form x belongs (belong) to S for all t in the domain of the definition of 
x{t). Let y be a locally Lipschitz continuous function. Recall that by Rademacher's theorem, the gradient W 
of V exists almost everywhere. Let R be the set of measure zero where W{x) does not exist. Then the Clarke 
generalized gradient of F at x is the set dV{x) = co{limi_j.+oo '^V{xi) : Xi —>■ x,Xi ^ S, Xi ^ R} where 



S is any set of measure zero in R^. We define the set-valued derivative of F at a; with respect to ( |15[ ) the set 
V{x) = {aeR:3v£ JC{F{x)) s.t. a = p.v, \/p e dV{x)}. 

Non-smooth LaSalle's invariance principle. Let y : M" ^- M be a locally Lipschitz and regular function. 
Let X E S, with S compact and strongly invariant for i G F{x{t)). Assume that for all a; G 5 either V" = or 
V C (— cx), 0] . Then any Krasowskii solution to i G F{x) starting from x converges to the largest weakly invariant 
subset contained in 5 n {x G M" : G V}, with the null vector in W\ 
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